Optimized Runtime Systems for MapReduce Applications in Multi-core Clusters
نویسندگان
چکیده
Optimized Runtime Systems for MapReduce Applications in Multi-core Clusters
منابع مشابه
Evaluating MapReduce for Multi-core and Multiprocessor Systems
As multi-core chips become ubiquitous, it is critical to develop parallel programming models and runtime systems that can harness their computational capabilities. In this paper, we evaluate the suitability of the MapReduce model for multi-core and multi-processor systems. MapReduce was developed by Google to program and manage data-centers with thousands of servers. It allows programmers to wr...
متن کاملMPI for Big Data: New tricks for an old dog
The processing of massive amounts of data on clusters with finite amount of memory has become an important problem facing the parallel/distributed computing community. While MapReduce-style technologies provide an effective means for addressing various problems that fit within the MapReduce paradigm, there are many classes of problems for which this paradigm is ill-suited. In this paper we pres...
متن کاملBitonic-MapReduce: Optimization of MapReduce on the Cell B.E. Architecture with a Bitonic Sort Senior Honors Thesis
The Cell B.E. Architecture is a novel, heterogeneous, multi-core architecture that offers opportunities for significant performance. However, a lack of programmer familiarity with explicitly parallelizing code and difficulty using its unique software-managed memory model make writing programs for the Cell difficult, even for experienced programmers. However, if tools can be made to abstract awa...
متن کاملMR-J: A MapReduce Framework for Multi-core Architectures
The trend toward multi-core technology has resulted in a search for various parallel programming models to make efficient use of multiple cores on microprocessors. MapReduce is a general-purpose programming model originally developed by Google that provides a simple and efficient platform for large-scale data processing in a distributed systems environment [1]. The simplicity of this model is t...
متن کاملMaking the most of a distributed perceptron for NLP
The perceptron algorithm (Rosenblatt, 1958), in particular the global linear model of Collins (2002), has been employed to handle NLP tasks such as part-ofspeech tagging, parsing, and segmentation. Many such tasks require vast training data to create robust models, which is very time-consuming and computationally intensive. It is natural to look to distributed systems to speed up training for t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014